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Abstract 

It has recently been emphasized again that the very existence of stationary stable localized 
structures with short range interactions might allow to store information in non-equilibrium media, 
opening new perspectives on information storage. We show how to use generalized topological 
entropies to measure aspects of the quantities of storable and non-storable information. This leads 
us to introduce a measure of the long term stably storable information. As a first example to 
illustrate these concepts, we revisit a mechanism for the appearance of stationary stable localized 
structures that is related to the stabilization of fronts between structured and unstructured states 
(or between differently structured states). 
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It has recently been emphasized again that the very existence of stationary 
stable localized structures with short range interactions might allow to store 
information in non-equilibrium media, in a way that would be both local and 
reversible. This has altogether opened new perspectives on information storage. 
While the theory of information was put of firm basis by Shannon as far back 
as 1948, the focus of this theory has been on models for the information itself, 
for which the concept of information theoretic entropy was proposed, and on 
transmission channels, for which the concept of channel capacity, later extended 
to topological entropy, was put forward. We show here that topological entropy, 
in its generalized form that accommodates multidimensional times as in foliation 
and tiling theories, characterizes nicely the amount of information that can be 
stored in non-equilibrium media with local stability in time. By measuring 
also the entropy of non-storable information, we get access to a measure of a 
fragility of the system. This fragility can be understood as the lack of localization 
of errors, hereby leading us to introduce a measure of the long term stably 
storable information. As a first example to illustrate these concepts, we revisit 
a mechanism for the appearance of stationary stable localized structures that 
is related to the stabilization of fronts between structured and unstructured 
states (or between differently structured states). The theory is far less complete 
for media of dimension greater that one, but the concepts and main effects of 
dimension one seem to work well for two dimensional media for reasons whose 
details elude us. 



INTRODUCTION 

Many extended systems excited far from equilibrium undergo a transition from a spatially 
homogeneous state to a periodic pattern. Classical examples are the discrete vibration modes 
of a string, locked at its extrema, the rolls and hexagonal structures formed by convection in 
a Rayleigh-Benard geometry, the Taylor- vortices in a Taylor-Couette system, the Faraday's 
crispations on the surface of a parametrically forced disk of liquid (or granular material), the 
Turing patterns developing in chemical or biological systems where reaction and diffusion 
between different specimen compete 0]. 

With regard to data storage, it is clear that a homogeneous solution cannot store infor- 
mation, and that a periodic pattern only contains information about a wavenumber and the 
position of one vertex, none of which has much value, while a localized structure with short 
range interaction would seem a much better candidate. Nonetheless, it is exactly the abil- 
ity of many physical systems to switch between two (or more) different stable states which 
is commonly exploited for information storage. More specifically, as already explained in 
0, for a quite general class of systems we can use the bistability between an homogeneous 
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and a cellular state, which is distinguished from the usual bistability between two homoge- 
neous states [l^l, to ensure the existence of stable localized structures and hence to store 
information on a medium. 

Static localized structures, seen as independent fragments of a structured solution, have 
been studied in many different physical systems, ranging from magnetic materials |l7j . to 
liquid crystals [3| and to chemical systems jlil ]. More recently, there has been a new 
surge of interest in the context of optics, where localized and controllable light spots have 
been considered as bits for information encoding and processing (see for instance 0| 
and [HI). 

In this paper we will address the problem of quantifying the quantity of information that 
can be stored and is made available in a non-equilibrium medium, and the associated problem 
of transition from poor to efficient storage performances in contexts where bifurcations 
toward localized solution is reasonably well understood. 

The discussion to follow is quite general, but to illustrate the mechanism we will here refer 
to a system described either by variational or nonvariational partial differential equations 
(PDEs) of the form: 

r)V 

d t u = -^-vV 2 u-V\, (1) 
ou 

where V = —fxu 2 /2 + u 4 /4 — r]u, or 

dV 

d t u = v + D u V 2 u, 

ou 

d t v = -yo + cu + D v V 2 v . (2) 

Equation (J2J) describes a chemical reaction, while is a generalization of the Swift- 
Hohenberg model 
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With solutions bi-asymptotic to an homogeneous solution, and a suitable choice of the 
parameter values, we have written HELLO in Figure 1-a, using Equation Q and equation 
121 would have worked as well. Even though the " HELLO" in Figure 1-a corresponds to a 
linearly stable solution, one expects that there be a drift in the presence of any non-zero 
noise, and Figure 1-c confirms this concern, even if one takes the best possible parameter 
values. Following the teaching of 0], one can also use solutions bi-asymptotic to a cellular 
solution to store information. We thus have accordingly again written HELLO in Figure 
1-b, also using Equation [T] and the same optimal parameter values used for Figure 1-a (as 
discussed in |2j; see also below). Figure 1-d, a snapshot after the same time used for Figure 
1-c, indicates that now the drift due to noise is, for the least, far less of a problem. The noise 
used is uniform in [— c, c] and the same non negligible value c = 0.2 has been used in both 
cases. The effect of this noise on the solution is almost negligible (and in fact fully negligible 
for all practical purposes if the noise remains within some reasonable bounds) in the presence 
of a cellular substrate and one uses a sub-lattice to carry the information: the single cells 
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are " locked" to their positions by the super-lattice that is not used to carry information (the 
sub- lattice constraint can be relaxed, as long as no large homogeneous patches are created). 
The same rigidity property evidently does not hold true on a homogeneous background. 
While we have used two dimensional simulation for the spectacular aspect and because 
that would be the dimension of most obvious practical relevance, the phenomenon displayed 
in Figure 1 exist in any dimension, and the remarks we have made one the difference of 
rigidities would apply as well. This qualitative argument furnishes an intuitive, but surely 
not rigorous interpretation of the behavior. On the other hand, the formulation of a precise 
^-dimensional theory, taking into account the effect of noise, stands beyond the scope of 
what can be done now. This is not surprising given the complexity of the problem even in 
the absence of noise. More precisely, some rigor can be obtained about the global theory of 
stationary solutions when 5 = 1 but for greater S or when time dependence is considered, 
there is no global theory available so far, even in the noiseless case. 

The bifurcation structure of stationary stable localized solutions near the domain P of 
existence of a stationary front between a cellular structure and an homogeneous state was 
described in , and in one- dimensional media: see Figure 2 which is described in 
detail below. As we move from the boundaries of the region of existence of a localized 
solution to the interior of this region, and further inside the region P, a variety of different 
stable states is encountered depending on the parameter range. The quantity of solutions 
that are available to the system becomes maximal in a special parameter range d, already 
singled out in 0, were one finds structures that were called fully decomposable. For such 
systems with parameters in d (we say a decomposable system), essentially any cell of a 
lattice intrinsic to the system can be set ON or OFF in a very recognizable way. Thus 
any information can be encoded with high density in the parameter range d. There is a 
problem here with the lattice if big patches get turned off, and it was suggested in to 
use in fact a sublattice to store information, and use the lattice also to recognize where one 
stands in the medium. This difficulty will be reconsidered later, hidden behind the issue 
of the discreteness quality of a system, i.e., how well it can be described as an assembly of 
bits. Cellular and homogeneous states clearly stand at the other end of the spectrum from 
decomposable systems in terms of efficiency in carrying information, and this despite the 
fact that all these states can be reached with the same medium or with the same equations, 
by just tuning the parameters. It was also documented in , and that similar 
phenomenology occurs in two-dimensional media. 

It has become clear, as we report here, that it would help a lot to quantify the information 
that can be stored in a medium, somewhat in analogy with the quantity of information that 
can be stored in a message as described in Shannon's theory. Chaos theory and the language 
thereof have greatly progressed folllowing the seminal paper of Claude Shannon [2^ (which 



can also be found in [2Jj and 22|) that put the theory of information on firm basis as far back 
as 1948. While the focus of Shannon theory has been on models for the information itself, 
for which the concept of information theoretic entropy was proposed, and on transmission 
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FIG. 1: Writing the message "HELLO" using stable stationary localized structures made of bumps 
(to the left) or of flats (to the right) on a medium of dimension two, using Equation^ to generate 
stable solutions. In (a) the message is coded with bumps on an homogeneous state; in (b)the 
message is coded with flats on a cellular substrate. In the lower panels (c) and (d) a nonzero 
noise is superposed: while a considerable drift is observed in panel (c), the effect of noise is far less 
important in (d), and anyway smaller than the cells sizes. The parameters values of the simulations 
are: r] = — 0.3, = —0.4 and v = — 2. The noise in (c) and (d) is uniform in [—0.2,0.2]. 

channels, for which the concept of channel capacity, later extended to topological entropy, 
was put forward, we will be able to build on these teaching, and in particular use Shannon's 
quantitative approach for our problems of storage. 
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MEASURING SPATIAL CHAOS 



We also learn from Shannon that it is convenient to begin with systems that are discrete 
as they are somewhat simpler to analyze. For a message, time is discretized by defining a 
unit of time, and one then uses as elementary information a symbol from a finite alphabet 
A (in most cases, A = {0, 1}) that is ascribed to each unit of time to form a message. For 
spatial chaos, instead on the one- dimensional time, one has a 5— dimensional medium, with 
8 > 1, so that discretization is more generally accomplished by defining a lattice. We will 
assume that in some parameter range, any cell of that lattice can similarly be ascribed a 
symbol from a finite alphabet A (and we will start with, A = {0, 1} to fix the ideas), in 
such a way that a field can be mimicked by a step function with constant value taken from 
this alphabet on each cell. 

The amount of spatial chaos, or amount of information that can be stored in the medium 
with unit of space fixed by the lattice is the topological entropy (in fact an obvious general- 
ization of Shannon's channel capacity), defined as: 

n m _ r log 2 (iV A (r)) 

^topological{A) — J^ 110 ^ ~g 5 \ 6 ) 

where N\(r) is the number of different patches that can be observed in a ball of radius r for 
the medium or equation with fixed parameter A. Here A can be a scalar or more generally 
a vector, but to study transitions from zero to maximal entropy, we will stick to scalar 
parameters in the present paper. Our C 'topological^) is also the quantity used to measure the 
topological entropy of other spatial systems, such as tilings of the plane or more generally 
tilings of 5— dimensional spaces. One should not be surprised to see topological entropy 
appear here since long after both concepts had been isolated (see jicj and |1] ), it has finally 
been recognized that Shannon's channel capacity is the topological entropy of a subshift of 
finite type. The historical filiation from to [jij (see als o p and 0) is indeed through 1^ 
(see also jssl). However, the Kolmogorov- Sinai entropy jl5| . j^] was not so much inspired 



by the Shannon capacity, but rather by the Shannon entropy (see j20|, |2l|, or |22|) for which 



Shannon was inspired by Tolman's dicussion of the entropy from statistical physics (see ; 
the reverse influence of Shannon's theory on physics being later initiated by Brilloin 0]). 

Topological entropy thus seems to capture nicely the complexity of information that can 
be stored with a stability that is local in space and time. However, in the context of storage 
arises the question of dynamical evolution of errors: if an error resulting from fluctuation 
bigger than the range of stability occurs, one would like this error to not propagate. It 
is fair to call forbidden state a state that, under too strong but still mild perturbation, 
degenerates in such a way that an unbounded amount of data gets erased. The collection of 
such forbidden states can be measured by an entropy C forbidden defined just the same way 
as before, and we can define the efficient entropy C e ff icient as the supremum of zero and the 
difference between the measure of complexity and the size of the forbidden set. Thus the 
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actual quality of storage for a given parameter A will be given by: 

C e ff identity = SU P Pi C topological (ty ~ C forbidden (<\)] • (4) 

In the upper portion of Figure 2 we have sketched, by making reference to the system 
described by Equation Q the qualitative behavior of the three entropies defined above with 
respect to the control parameter A. The topological entropy C 'topological is zero at the ex- 
terior of region of existence of stationary stable localized solution. This parameter range 
for Ctopoiogicai = is slightly bigger and strictly contains the pinning region P. Now the 
topological entropy C top oiogicai is uniformly equal to one in the interior of P, where the 
number of observable static states is maximal. But information storage is made more and 
more effective only when one approaches the decomposability region d, since along this ap- 
proach the efficient entropy C e //j C j ent increases and the entropy Cf or bidden of the forbidden 
sets decreases. Eventually, the noise fluctuations are no more destructive inside the param- 
eter range d where the efficient entropy reaches its maximal value, equal to one, since the 
forbidden entropy drops to zero. 

STATIONARY STABLE LOCALIZED STRUCTURES: THE PHENOMENOLOGY 

Having now means to measure chaos for stored information and stably stored information, 
we can next describe examples which have motivated the relevant entropy concepts; we refer 
the reader to Ml for more details (see also fl, and 0)), but only the phenomenology will 
be essential to our discussion, and not the mathematical developments provided in those 
papers to justify and explain such phenomenology. 

We will distinguish what we call stable and unstable landscapes. As a default option, 
we will say landscape for stable landscape. A landscape is thus a stable solution up to 
translation of the PDE, or more generally corresponds to a state that can stably be observed 
on local fields in a non-equilibrium medium. Landscapes are defined up to translation, so 
that a landscape corresponds to infinitely many solutions: hence solutions are in one to one 
correspondence with landscapes with a marked point, objects that we also call configurations. 
A state is what a landscape (or a configuration) locally looks like: thus landscapes can either 
exhibit the same state all over, or a coexistence of states. 

Consider a one dimensional medium which, depending on a control parameter A, can 
exhibit both a homogenous landscape H (hence a stable homogenous state all over the places) 
for low values of A, and a periodic landscape C (hence a stable cellular state all over the 
places) for high values of A. We also assume that these states (whose precise description, 
involving for instance the wavelength in the case of a cellular state, is expected to depend on 
A) coexist (met a-) stably in a single parameter range B, that contains a pinning sub-range 
P = [c^hA, Ah^c] where states that present a stable front between the homogenous and 
cellular state can be observed. For A <c^h A, the front is unstable with the cellular state 
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FIG. 2: In the upper part of the figure, the three entropies C x used to measure spatial chaos 
when the parameter A is varied: the thick dotted line is the topological complexity C t0 poiogicah the 
dashed grey line represents the amount of forbidden states C forbidden, the solid thinner line is the 
efficient entropy C e ffid en t, given by Equation 0J In the lower part of the figure, the bifurcation 
structure near the pinning region P. The horizontal axis is the parameter A, the vertical axis the 
velocity v of the front. Overbars correspond to bubbles, underbars to flats (e.g.: [T, l' is where 
a stationary stable localized strucrture with a single bump can be observed). The sub- interval d 
of P is the region where the structure is fully decomposable: this is where one should be for best 
data storage applications. In the insets are three x-t diagrams for A to the left, inside of, and to 
he right of P. 



turning to homogeneous as the front moves (hence the C i— > H left subscript of c^hA: see 
the leftmost inset in Figure 2, where the vertical axis is time while the horizontal axis is 
along the medium), while for A > Ah^c, the front is unstable with the homogeneous state 
turning to cellular as the front moves (hence the H h> C right subscript of Ac^h : see the 
rightmost inset in Figure 2). 

Mechanisms for the existence and robustness of such stable fronts were discussed by 
Pomeau in & and revisited in Q, Q using the concept of reversible system which was 
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isolated (with no view on application to PDE's) by Devaney 0] i n the context of maps 
and ODE's. It was also explained in 0, Q, and that for some mechanism at least 
that allows the phenomenology described so far, these phenomena come accompanied with 
a complicated intertwining of parameter intervals I a , that carry different possible stable 
states Sq, so that in the intersection of I ai and I a2 , both of the states S ai and S a2 can be 
stably realized. 

We will need some vocabulary and notation to discuss respective positions of intervals and 
phenomena, as this will be essential to understand the parameter dependent phenomenology 
of stable stationary solutions. Thus, if two intervals intersect in such a way that none 
contains the other one and so that they share no extreme points, we say that one is kicked 
(or more precisely kicked to the right or two the left) of the other one (which is then of 
course kicked respectively to the left or right of the first one). For instance the interval [2, 5] 
is kicked to the right of [1,3], and we notice that these two intervals have different length, 
which is possible but not necessary when one interval is obtained from another one by a 
kick. 

We are going to consider two types of localized states: 

- the n-bumps states which correspond to a succession of exactly n bumps with flats on 
both sides (after some oscillatory damping tail), 

- the m- flats states which correspond to a succession of at least m and less than m + 1 
flats of the unit length that is the size of the bumps, with bumps on both sides (after some 
oscillatory expansion tail). 

One can of course code the patterns that will be possible by associating loosely a 1 to a 
bump and a to a flat, and more precisely: 

- a l n to an n-bumps state read to the right, 

- a ~ n l to an n-bumps state read to the left, 

- a m to an m-flats state read to the right, 

- a _m to an m-flats state read to the left, 

where "to the left" and "to the right" means to the left and to the right of a reference 
point, represented by the next symbol respectively to the right and left of the superscripted 
symbol. Using minus signs allows a local reading: it allows to recognize if a superscript 
is attached to the symbol to its left or to its right without having to see the whole word, 
assuming even such view is at all possible. 

Then a symbolic configuration on the real line R, which is everywhere made of bumps and 
flats can be represented by a bi-infinite word in the alphabet A2 = {0, 1}. For instance, the 
homogeneous state H is represented by -^(J 00 and the cellular state C by -^l 00 while stable 
fronts appear as -^Ol 00 and "^lO 00 . Local segments of the medium can similarly be coded 
by finite words in A2 and in most cases, one can as well dispense of negative exponents as 
one can always read to the right when dealing with finite words (negative exponents may 
however reveal handy when one intends to take some limits). 
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In Figure 2 the horizontal axis is the parameter A while the vertical axis is the mean 
velocity v of the front, which is thus zero on the interval P = [Ach 5 Ahc] where there are 
stable static fronts between the states H and C. The numbers with overbars correspond to 
bubbles, while the numbers with underbars correspond to flats. More precisely: 

[n, n'] is where a stable localized solution, symbolized as °°oi n 00 (or 
~ 00 0~ n 10 00 ), with exactly n consecutive bubbles can be observed, 

[m, m'] is where a stable localized solution, symbolized as <x>iQmi°° ( or 
_00 l _m 01 00 ), with exactly m consecutive flats can be observed. 
Furthermore: 

- for any two positive integers p and q with q > p, \q,q'} is kicked to the left of [p,p'}; 

- for any two positive integers p and q with q > p, [q, q'] is kicked to the right of [p,p']; 

- for any four positive integers n, m, p, and q [m, n'] is kicked to the right of [p, q']. 

At last, the sequences {n} and {m} accumulate on c^hA respectively from the right and 
from the left, while the sequences {n'} and {m'} accumulate on Ah^c respectively from the 
right and from the left. 

As discussed in 3|, the interval [T, T], which is marked d on Figure 2, is the parameter 
region where the structure is fully decomposable in the sense that packets of bumps or holes 
can essentially be created at will (when and where needed). It was argued in |j| that this 
parameter range is where information storage and retrieval would be most efficient; otherwise 
speaking, d is the parameter range that one should pick for data storage applications. We 
will see here that the quality of storage, as well as the spatial chaos, can be measured by 
the entropies that we have defined, giving a more precise viewpoint on what was proposed 
in B. 



TRANSITION TO CHAOS: LANDSCAPE COMPLEXITY 

The complexity of the observable landscapes on (^-dimensional media increases when we 
move in the parameter space from the cellular to the chaotic state, and decreases back to 
zero when we reach the homogeneous state. Even though the phenomenology in the two 
dimensional case looks similar to that which one observes in dimension one, the mathematical 
analysis of the mechanisms behind the phenomena has so far only been developed in the 
latter case. For this reason we describe the transition to chaos in spatial dimension 6=1, 
using the notations we have developed to segment the A parameter space. 

As we drive A inside the Pomeau region, C 1 topological^) undergoes a continuous transition: 
it starts from far enough at the exterior of the pinning region and it becomes uniformly 
equal to 1 = log^l over all of P. More precisely: 

The set of landscapes in interval (2', 1'] is the set of orbits of the sub shift of finite type 
generated by {10" 1 ' 1 , 0} for some mi that decreases as one gets (to the left in Figure 2) toward 
the pinning region. 
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When crossing 2' while moving the parameter towards P, words containing 11 begin to 
be permissible, and the minimal number w! 2 of consecutive zero's after a 11 block decreases 
as one gets toward the pinning region. 

With no orbit loosing allowability till one reaches the boundary of the pinning region, 
when crossing n', words containing l n ' begin to be permissible, and the minimal number 
m' n , of consecutive zero's after a l n ' block decreases as one gets toward the pinning region. 

A similar description works when moving in the other direction on the other side of the 
pinning region, with the roles of O's and l's exchanged , and n replacing n'. For instance, the 
set of landscapes in interval [1, 2) is the set of orbits of the subshift of finite type generated 
by {01 mi , 1}, for some m 1 that decreases as one gets (to the right in Figure 2) toward the 
region P. 

The entropy thus increases as A gets toward P, and is uniformly 1 in P as was told. 

The description given before of the intervals of the form [p, p'\ or [g, q'} allow then to see 
that, when considering A G P, the entropy of forbidden words is zero exactly in [1,1']. This 
entropy increases on both sides of [1,1'], when moving towards the bounds of P, reaching 1 
precisely at the extreme points of P. 

Hence, not all the entropy measured in the Pomeau region can effectively be used to 
handle information. Even inside the pinning region there are still landscapes that are not 
accessible for information applications, the optimal parameter set being the decomposability 
region d = [1,1'], which is precisely the locus of parameter values where C e ffi C i en t(X) = 1. 

At this point, we should get back to the observed better quality of using coding by O's (for 
flats) on a l's (for bumps) basis over the other way round (see Figure 1 and the accompanying 
comments). On the other hand, the story is totally symmetric between O's and l's at the 
symbolic level under the proper change of parameter. More precisely, for any phenomenology 
with O's and l's seen for some A, there should be a symmetric phenomenology with l's and 
O's that one should expect to see at some other value of the parameter value A'. What 
seems to be a contradiction is due to the fact that all the analysis that we have presented 
so far has been made under the hypothesis that there was formation of a lattice, i.e., under 
the hypothesis that coding is well defined. For a lattice to lead to a symmetry between O's 
and l's, the lattice has to have cells that behave as stably when they are marked or 1. 
This symmetry happens to be much more the case, with an effective quantization of the 
lengths of the cells, when there is an overall lattice of bumps with a sub-lattice devoted 
to carry the information as was proposed in 7]. Otherwise speaking, the more one gets 
closer to the parameter range d, the more the assumption that there is a good coding with 
O's and l's is true. The theory that we have developed takes in effect all its sense in d 
with information-carrying sub-lattices on a structured substrate, where the theory is most 
important for applications, and where the limitation on the effective entropy does not come 
from forbidden configurations, but from the fact that one use only a sub-lattice for coding. 
For instance, in d when 5 = 1, if one uses only one site out of two for coding, the effective 
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entropy available for information is ^ an d i n general, in any dimension, this effective entropy 
decreases proportionally to the density of the information carrying sub-lattice. 



CONCLUSION 

In this paper we have made the first step to the formulation of a coherent theory of 
classical information storage. At this point, we only have the rudiments of a stability theory 
for the stationary case when the storage medium has dimension one. For that, we needed 
some measurable quantities which we expect to be useful far beyond the scope of where we 
have theoretical control. It would be nice to have an extension of the theory of information 
storage to more general cases, including higher dimension and spatio-temporal patterns (so 
that the dynamics may help for instance in aspects of information processing), perhaps also 
to quantum information. 
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